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5 RELTED APPLICATION 

This application claims priority based upon provi- 
sion patent application patent application Serial No. 
60/199,011, "Methods for Synthesis of International Com- 
bustion Engine Vehicle Sounds", filed April 20, 2000. 

10 

FIELD OF THE INVENTION 

The present invention relates to electronic and com- 
puter synthesis of sounds. More specifically, it relates 
to devices and methods for the synthesis of internal com- 
15 bustion engine vehicle sounds using physical models. 

BACKGROUND OF THE INVENTION 

Many computer- implemented games and simulations in- 
volve internal combustion engine vehicles such as automo- 

20 biles, motorcycles, airplanes, and boats. An important 
part of the simulation is the generation of sounds, which 
should resemble real vehicle sounds as much as possible. 
In particular, as the simulated vehicle conditions 
change, the computer generated sound should change ac- 

25 cordingly. One known technique for generating such vehi- 
cle sounds uses a set of digitized recordings of the ve- 
hicle's sound under a few specific conditions (e.g., at 
certain vehicle speeds) . These recordings are then 
played back using an interpolation technique to generate 

30 a vehicle sound under any conditions (e.g., at any vehi- 
cle speed) . This technique, however, has several prob- 
lems and disadvantages. For example, the recordings re- 
quire significant memory storage space, and are limited 
to a single vehicle. Moreover, the recordings typically 
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vary only one parameter (e.g., vehicle speed) while ig- 
noring the possible variations of other independent pa- 
rameters {e*g,, engine load). As a result, the generated 
sound is either unrealistic or requires many more record- 
5 ings and much more memory storage space to account for 
these additional parameters. Another problem with this 
technique is that the interpolation techniques introduce 
unrealistic distortions into the generated sounds. For 
example, an interpolation between two recorded vehicle 

10 speeds might involve oversampling a recording at a higher 
speed and/or undersampling a recording at a slower vehi- 
cle speed. Some components of the vehicle sound, how- 
ever, do not scale with the engine speed in this manner. 
The result is that the generated sound will be unrealis- 

15 tic. Yet another disadvantage of using recordings is 
that they are specific to particular vehicles. In order 
for a game or simulation to allow for a variety of vehi- 
cle types, a very large number of recordings must be made 
under a large number of different vehicle operating con- 

20 ditions, and all the recordings must be stored. Clearly, 
there is a need for improved techniques for generating 
vehicle sounds for computer simulators and games . 

SUMMARY OF THE INVENTION 

25 In one aspect of the present invention, computer- 

implemented techniques are provided for synthesizing 
sounds of an internal combustion engine vehicle using a 
physical model of the vehicle. In general terms, the 
method includes independently generating and/or synthe- 

30 sizing separate components of the vehicle sound, then 
combining these components to produce a final sound. Us- 
ing a physical model of the vehicle, the separate compo- 
nents of the vehicle sound are independently generated 
from vehicle control parameters characterizing the oper- 

35 ating conditions of the vehicle. The components are then 
combined using mixers and equalizers to produce a realis- 
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tic vehicle sound. The present technique allows inde- 
pendent control of the separate components of the vehicle 
sounds is not limited to specific vehicles, and does not 
require recorded sounds taking large amounts of storage 
5 space . 

In preferred embodiments of the invention, the 
physical model of the vehicle has sound-producing and 
sound-modifying signal processing blocks (e.g., spark 
generators, fuel ignition, and exhaust system) , and also 

10 provides for additional noises (e.g., wind and road 
noise, suspension noise, and transmission noise) , By ad- 
justing the synthesis parameters, the techniques can be 
used to synthesize sounds produced by a wide variety of 
vehicle types, including but not limited to cars, trucks, 

15 motorcycles, boats, propeller airplanes, and trains. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram illustrating a synthesis 
architecture for creating a sound produced by a four- 
20 engine vehicle, including speed-related sounds such as 
wind noise. 

FIG. 2 is a diagram illustrating the details of en- 
gine sound block shown in FIG. 1. 

FIGS. 3A and 3B are block diagrams of two embodi- 
25 ments of an engine process model signal processing block 
shown in FIG. 2. 

FIG. 4 is a block diagram illustrating the compo- 
nents of spark timing controlled sound signal processing 
block shown in FIG. 2. 
30 FIG. 5 is a block diagram illustrating the compo- 

nents of the direct RPM controlled sound signal process- 
ing block shown in FIG. 2. 

FIG. 6 is a block diagram illustrating the compo- 
nents of the RPM related sound signal processing block 
35 shown in FIG. 2. 
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FIG. 7 is a block diagram illustrating the compo- 
nents of the speed related sound signal processing block 
shown in FIG. 1. 

FIG. 8 is a block diagram detailing the engine 
5 physical model shown in FIG. 3A, 

FIG. 9 is a block diagram illustrating an example of 
an exhaust system model, which preferably forms a compo- 
nent within the spark timing controlled sounds block of 
FIG. 4. 

10 FIG. 10 is a diagram illustrating a variation of the 

engine sound block shown in FIG. 2, wherein optional load 
effect modules are included. 

FIG. 11 is a diagram illustrating the details of the 
load effect modules shown in FIG. 10. 

15 

DETAILED DESCRIPTION 

The following description and related figures illus- 
trate the techniques of the present invention in the con- 
text of various specific embodiments. Those skilled in 

20 the art will appreciate that many of the details of the 
following embodiments are not necessary for the practice 
of the invention, and are included for illustrative pur- 
poses only . The techniques of the present invention may 
be implemented in the form of instructions stored in a 

25 memory and executed by a general purpose microprocessor 
present in a desktop computer, laptop computer, video ar- 
cade game, and the like. The techniques of the present 
invention may also be implemented in hardware, i.e., us- 
ing an ASIC that is part of a computer system. The syn- 

30 thesized signals from the microprocessor or ASIC are out- 
put to a user using an audio sound system that is either 
internal to the system or part of an external sound sys- 
tem connected to the computer system. The hardware pref- 
erably includes conventional state-of-the-art components 

35 well known in the art. Because the primary distinguish- 
ing features of the present invention relate to the spe- 
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cific synthesis techniques, the following description 
will focus on these techniques, 

FIG. 1 is a block diagram illustrating a synthesis 
architecture for creating a sound produced by a four- 
5 engine vehicle, including speed-related sounds 2 such as 
wind noise which are produced in response to sound con- 
trol parameters 4 . This architecture is appropriate for 
synthesizing the sound of a four-engine aircraft, A sin- 
gle engine aircraft (or a car) would have a similar ar- 

10 chitecture, but with just one engine sound block 6a 
rather than four 6a, 6b, 6c, 6d produced in response to 
one set of engine control parameters 8a rather than four 
8a, 8b, 8c, 8d, The speed-related sounds block 2 is 
preferable, but not necessary. In the case of an air- 

15 craft, it primarily synthesizes wind noise. In the case 
of a land or water vehicle, it preferably synthesizes ad- 
ditional noises. For a land vehicle, it will preferably 
synthesize road noise, and for a water vehicle it will 
preferably synthesize water noise. It should be noted 

20 that these noises are related only to the speed of the 
vehicle, and do not depend directly on the vehicle en- 
gine. For example, a car coasting down a hill with its 
engine off will generate wind noise even though the en- 
gine is stopped. Conversely, a car parked at the start - 

25 ing line and racing its engine just before a race begins 
will have engine noise but no speed-related wind noise. 
Because these separate signal processing blocks 2, 6a- 6d 
are independently controlled, the appropriate sound under 
these various vehicle conditions will be realistically 

30 synthesized. The audio signals generated by these sepa- 
rate blocks are combined in an EQ and mixer 10 to produce 
the final vehicle sound. The EQ filter, which is typi- 
cally a simple first-order filter, can be controlled to 
adjust the relative strengths of the various components, 

35 accounting for whether the sound is being heard from in- 
side the vehicle or outside the vehicle, from in front of 
the vehicle or behind the vehicle, from nearby or far 
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away, and so on. Signal processing at the output stage 
can also be used to simulate other effects, such as 
acoustic reflections from nearby structures, 

FIG. 2 is a diagram illustrating the details of en- 
5 gine sound block 6a shown in FIG. 1. The control parame- 
ters 8a provided to the engine sound block as input are 
preferably parameters that represent natural physical op- 
erating controls or conditions of the vehicle being mod- 
eled. These controls preferably comprise one or more of 

10 the following parameters: engine RPM, engine load, vehi- 
cle acceleration, transmission gear ratio, throttle posi- 
tion, propeller pitch, and fuel mixture. Other parameters 
may also be included among these control parameters, as 
appropriate. These control parameters are used by an en- 

15 gine process model 12 to generate various derived quanti- 
ties, such as RPM 14, engine load 16, and spark events 
18. In cases where the RPM is not a primary control in- 
put, it is calculated. Similarly, if the engine load is 
not provided, it is calculated. If these parameters are 

20 provided as input, however, then they are simply passed 
through the engine process model 12 to the other signal 
processing blocks, as shown in the figure. The specifics 
of the engine process model will be described in more de- 
tail below in relation to FIGS. 3A and 3B. The load and 

25 spark event signals 16, 18 from the engine process model 
enter a spark timing controlled sound processing block 
20, which will be described in more detail below in rela- 
tion to FIG. 4. This block 20 models the engine combus- 
tion chamber, exhaust manifold, and other vehicle systems 

30 through which the spark-initiated explosive sounds propa- 
gate. The load and RPM signals 16, 18 from the engine 
process model 12 are input to the direct RPM controlled 
sound processing block 22 and RPM related sound process- 
ing block 24, as shown. The direct RPM controlled sound 

35 processing block 22, which will be described in more de- 
tail in relation with FIG. 5, models engine sound compo- 
nents that are directly tuned to RPM, but are not re- 
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quired to be phase -locked with spark timings . These in- 
clude nonspecific timbral components that a sound de- 
signer may wish to include to enhance the sound quality, 
or specific vehicle sounds (such as a feedback FM heli- 
5 copter model) that are created through algorithms which 
cannot be driven by spark timing models of FIGS . 3 A and 
3B. The RPM related sound processing block 24, which will 
be described in more detail in relation with FIG, 6, mod- 
els various engine sounds related to the RPM, such as 

10 whines, whistles, roars, turbines, and rumbles. The tone 
qualities of the sounds generated by these blocks is con- 
trolled by the engine load signal. The sounds produced by 
these various blocks are combined in an equalizer and 
mixer 25, then output from the engine sound block. 

15 FIGS, 3A and 3B are block diagrams of two embodi- 

ments of an engine process model signal processing block 
shown in FIG. 2. The embodiment 12a shown in FIG. 3A il- 
lustrates a physical model 26 which generates RPM and 
spark event signals together. A load behavior model 28 

20 independently generates engine load parameters 16 from 
the control inputs. In this embodiment, a "gas pedal" 
control input can control the Load directly, and the RPM 
14 and Sparks 18 are generated together through a physi- 
cal model 2 6 of a combustion engine driven by the gas 

25 pedal input signal. This physical model has the advantage 
that it produces very authentic non-periodic "rough" en- 
gine sounds . 

The embodiment 12b shown in FIG. 3B illustrates a 
model in which the sparks 18 and RPM 14 are generated 

30 separately. An engine inertia and load model 3 0 generates 
load 16 and RPM 14 parameters. The RPM parameter, in 
turn, is input to a spark timing generator 32 that pro- 
duces spark event signals 18, This approach is less real- 
istic than the physical model shown in FIG. 3A, but it 

35 has the advantage that it can take RPM as input. The en- 
gine inert ial and load model 3 0 can be implemented in 
various ways. In a preferred embodiment, it is imple- 
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merited in one of three possible ways, depending on the 
particular application: 

1 . A throttle input drives an RPM and load output 
directly through first order smoothing effects such that 

5 RPM lags behind the throttle position modeling engine in- 
ertia at a Longer T60 (e,g,, 5-10 sec), and Load tracks 
throttle position much more quickly (e.g., at a T60 of 
0 . 3 sec . ) . 

2. RPM tracks an RPM input directly, and Load corre- 
10 spends to an acceleration derived as a first derivative 

of RPM. 

3 . Load and RPM are controlled directly by an exter- 
nal Car physics model generated from another application 
program (such as a race car simulation game) . 

15 

Unpredictable behaviors (e.g., a "rough" engine) can 
be introduced using a stochastic modulation of the RPM. 

FIG. 4 is a block diagram illustrating the compo- 
nents of the spark timing controlled sound signal proc- 

20 essing block 20 shown in FIG. 2. Spark event signals 18 
and load signals 16 from the engine process model 12 
(i.e., a train of impulses representing spark timings and 
numerical parameters representing a degree of load) are 
input to the block 2 0 and provided to one or more inter- 

25 nal blocks, as shown. The engine resonance model block 
34, for example, converts each spark impulse into a short 
resonant pulse (e.g., by passing the impulse through a 
second order resonant filter whose parameters may depend 
upon the load signal) . The turbulence model block 3 6 in- 

30 corporates a pulsed noise model of turbulence. The air 
chop model 3 8 simulates air turbulence sounds such as 
those associated with propeller movement in an airplane. 
The one-shot sound file playback algorithm (40) can be 
used to add in recorded or synthesized sounds associated 

35 with a single spark of the engine, perhaps individual mo- 
torcycle or airplane "puts", or more complex non-physical 
sounds which may suggest space vehicle qualities. The 
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one -shot sounds file playback algorithm could be used by 
the sound designer to add in arbitrary spark synchronized 
sounds components which may enhance the overall vehicle 
sound. Other blocks could be added here to simulate muf- 
5 fler resonances in an exhaust system model 42, or sounds 
related to piston movements and reactions which are syn- 
chronized with the spark timings. The sounds produced by 
the various blocks are combined in an equalizer and mixer 
43, then output from the spark timing controlled sound 
10 block. 

FIG. 5 is a block diagram illustrating the compo- 
nents of the direct RPM controlled sound signal process- 
ing block 22 shown in FIG. 2. RPM 18 and load 16 signals 
from the engine process model are input to the block 22 

15 and provided to one or more internal blocks, as shown. 
The direct RPM controlled sounds are the sounds which are 
tuned exactly to RPM, but which do not require exact syn- 
chronization with the spark timings. The cross-fade loops 
block 44 could be used to add in recorded loops of real 

20 engine sounds, tuned to RPM, or to introduce more hypo- 
thetical sounds of spaceships that a sound designer may 
create. The Feedback FM block 46 could be used to create 
helicopter-like engine and propeller chop sounds. Other 
blocks might be used to create RPM tuned sounds that can- 

25 not be controlled easily by the spark timing elements of 
FIGS. 3A and 3B . The sounds produced by the various 
blocks are combined in an equalizer and mixer 47, then 
output from the direct RPM controlled sounds block. 

FIG. 6 is a block diagram illustrating the compo- 

30 nents of the RPM related sound signal processing block 24 
shown in FIG. 2. RPM 14 and load 16 signals from the en- 
gine process model 12 are input to the block 24 and pro- 
vided to RPM translation blocks 48a, 48b, 48c, 48d, 48e . 
. 48n, and then to one or more internal blocks, as 

35 shown. RPM related sounds are correlated with RPM, but 
not necessarily in a linear or fixed way. For example a 
turbo charge sound may increase frequency with increased 
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RPM, but in a more complex way than a direct scaling. The 
RPM translation blocks convert RPM to frequency and/or 
other sound control parameters which directly control the 
sound of the RPM related blocks. The output from these 
5 translation blocks is fed to various other blocks that 
simulate particular noises. For example, the whistles 
block 50 simulates engine whistle- type noises, the 
whines block 52 simulates engine whine noises, the engine 
roar block 54 simulating lower frequency roaring noises, 

10 the turbines block 56 is used in vehicles that have tur- 
bines in their engines, and the FM rumble block 58 pro- 
duces rumbling noises. Other blocks might be implemented 
to simulate non-physical sounds as may be produced from a 
space vehicle, or a larger-than-life monster truck. These 

15 RPM related (but not direct RPM controlled) sounds can 
add a great deal of liveliness to the overall composite 
sound by the very fact that their pitch relation to RPM 
is not constant. It should be noted that the particular 
combination of blocks used in a particular embodiment 

20 will depend on the specific vehicle. Vehicles without 
turbines, for example, will not make use of the turbine 
block 56. The signals from these various blocks are com- 
bined in an equalizer and mixer 6 0 and output from the 
block as an audio signal. As with the blocks in FIGS. 4 

25 and 5, these various blocks may have filters whose pa- 
rameters depend on the load signal provided to the 
blocks, as shown. 

FIG. 7 is a block diagram illustrating the compo- 
nents of the speed related sound signal processing block 

30 2 shown in FIG. 1. Control signals such as vehicle speed 
and road surface conditions are input to the block and 
provided to one or more internal blocks, as shown. The 
road noise block 62 simulates road-related noises that 
depend on the type of surface, the wind noise block 64 

35 simulates air flow noises due to vehicle movement through 
the atmosphere, the tire noise block 66 simulates noises 
due to the type of tire tread, as well as other effects 
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such as tire chains and studs. Other similar blocks can 
be implemented that are related only to vehicle speed. 
For example, the clanking sounds related to a tank move- 
ment is related to speed, but not engine RPM. It could be 
5 implemented by a resonance model of the metallic clanks 
of the tank treads as they roll over various terrains. 
VJall scrapes as a car may make as it glances of a wall 
may be implemented here. Tire skid sounds may be imple- 
mented as a speed related algorithm, gated by whether the 

10 wheels are turning or not . It should be noted that the 
particular combination of blocks used in a particular em- 
bodiment will depend on the specific vehicle. Aircraft, 
for example, will primarily have wind noises, although 
some implementation of runway and tire noise is prefer- 

15 able to properly simulate noises during take-off, land- 
ing, and taxi. The signals from these various blocks are 
combined in an equalizer and mixer 68 and output from the 
block 2 as an audio signal. 

FIG. 8 is a block diagram detailing the engine 

20 physical model 26 shown in FIG, 3A, A starter motor pro- 
vides an initial instantaneous shaft velocity (RPM) 14 in 
response to an engine start control signal. An angular 
integrator 72 generates from the shaft velocity a shaft 
angle 74, which is input to a spark timing model 76. The 

25 spark timing model 76 simulates the firing of sparks at 
various shaft angles. The output of the spark timing 
model is a sequence of spark impulse event signals 18 
that simulate the firing of various sparks. The spark 
timing model is preferably implemented by a collection of 

30 spark triggers connected in parallel. Each trigger is set 
to a different shaft angle, so that their spark events 
are not simultaneous. The spark impulse events from all 
the triggers are combined in an adder to form a composite 
sparks signal 18. 

35 The sparks signal 18 from the spark timing model 76 

is sent to a spark-force-to-velocity converter 78 which 
models the physics of the engine that turns an electrical 
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spark into angular shaft velocity. The converter 78 com- 
prises an integrator implemented using a second-order 
filter for flexibility in tuning. The poles of the fil- 
ter are preferably placed near z=l, although other fre- 
5 quencies are possible. The computed shaft velocity is 
sent to a velocity regulator 80 which also models some of 
the physics of the engine. In particular, the velocity 
regulator models such factors as load, friction, and 
throttle. The primary purpose of this block 80 is to 

10 prevent the engine from increasing its RPM in an un- 
bounded manner, and to provide a means for controlling 
the RPM (e.g., with the throttle control signal). The 
resulting shaft velocity output 82 is injected back into 
the loop, and the cycle continues. 

15 The engine inertia and load model 30 of FIG. 3B uses 

the same techniques as the physical engine model 26 de- 
scribed above in relation to FIG. 8. Rather than taking 
the spark signals 18 from the physical model, however, 
the embodiment of FIG. 3B generates them with a separate 

20 spark timing generator 32, which is composed of an angu- 
lar integrator and spark timing model, as described in 
relation to FIG, 8. 

FIG. 9 is a block diagram illustrating an example of 
an exhaust system model 42, which preferably forms a com- 

25 ponent within the spark timing controlled sounds block 2 0 
of FIG. 4. The spark impulse signals 18 first enter an 
explosion spreading model 84, which simulates the spread- 
ing of the initial pressure wave of the ignition explo- 
sion. In preferred embodiments, this explosion spreading 

30 block is implemented with a lowpass filter designed to 
spread the impulses. 

The spreaded signal 86 from the explosion spreading 
model 84 is then input to a turbulence model 88, which 
simulates the various constrictions and/or bends in the 

35 exhaust system waveguide. These bends and constrictions 
introduce noise into the signal, with the amount of noise 
depending on the velocity of the pressure wave. The tur- 
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bulence model is preferably implemented using filtered 
white noise that is introduced into the signal in propor- 
tion with the signal intensity. 

After passing through the turbulence model 88 , the 
5 signal enters a filtering resonance model 90, which is 
designed to simulate the exhaust muffler. This filter is 
preferably implemented using a few second-order resonant 
lowpass filters connected in parallel. 

Because filtering and turbulence happen at various 

10 places along the exhaust path, and because turbulence is 
not a linear filtering, it is preferred in a more realis- 
tic exhaust system implementation to cascade multiple 
turbulence-filtering pairs, rather than just one pair as 
shown in the figure. In addition, certain pairs may be 

15 connected in parallel rather than cascaded. Very realis- 
tic sounds, however, can be produced using just one tur- 
bulence-filtering pair. 

FIG. 10 is a diagram illustrating a variation of the 
engine sound block 6a shown in FIG. 2. This variation of 

20 the engine sound block is the same as that described in 
relation to FIG. 2, with the exception that one or more 
optional load effect modules may be included, as shown. 
Preferably, the modules are inserted in one of three 
ways: 1) a single module 92 between the spark timing con- 

25 trolled sounds and the equalizer and mixer block 25, 2) 
a single module after the equalizer and mixer block 94, 
or 3) three modules 92, 96, 98, where each one is in- 
serted just before the equalizer and mixer block 25, as 
shown, with inputs from the engine load signal 16 and, 

30 respectively, the spark timing controlled sounds 22, the 
direct RPM controlled sounds 22, and the RPM related 
sounds 24. Other configurations are also possible. 

FIG. 11 is a diagram illustrating the details of the 
load effect modules shown in FIG. 10. An audio signal 10 0 

35 entering the module goes into a scale block 102 which is 
controlled by the load signal 16. The scaled audio sig- 
nal 104 then passes into a non-linear distortion unit 
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lOG. This nonlinear-distortion could be implemented as a 
hard clipping (meaning all input samples greater than 1 
are set to 1, and all input samples less than -1 are set 
to -1, the rest are unmodified) , or a "soft" clipping 
5 (such as a look-up table with a smooth monotonically in- 
creasing set of values centered at 0) . 

The load effect module simulates the "load" sound 
effect which happens, for example, when you push the gas 
pedal to the floor and accelerate a car. In this case, 

10 the load control signal would increase the scaling of the 
audio input, causing the non- linear distortion to produce 
a more "loaded" (i.e., broader spectrum) sound. 

An alternative implementation of the load effect 
module has a scale and low pass boosting filter instead 

15 of just a scale alone . In this way, when the load con- 
trol signal is increased, the audio signal input is bass 
boosted and then this lower frequency signal is distorted 
in the nonlinear distortion element giving a more "beefy" 
loaded sound. 
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